Associating Facial Expressions and Upper-Body Gestures with Learning Tasks for Enhancing Intelligent Tutoring Systems

Learning involves a substantial amount of cognitive, social and emotional states. Therefore, recognizing and understanding these states in the context of learning is key in designing informed interventions and addressing the needs of the individual student to provide personalized education. In this paper, we explore the automatic detection of learner’s nonverbal behaviors involving hand-over-face gestures, head and eye movements and emotions via facial expressions during learning. The proposed computer vision-based behavior monitoring method uses a low-cost webcam and can easily be integrated with modern tutoring technologies. We investigate these behaviors in-depth over time in a classroom session of 40 minutes involving reading and problem-solving exercises. The exercises in the sessions are divided into three categories: an easy, medium and difficult topic within the context of undergraduate computer science. We found that there is a significant increase in head and eye movements as time progresses, as well as with the increase of difficulty level. We demonstrated that there is a considerable occurrence of hand-over-face gestures (on average 21.35%) during the 40 minutes session and is unexplored in the education domain. We propose a novel deep learning approach for automatic detection of hand-over-face gestures in images with a classification accuracy of 86.87%. There is a prominent increase in hand-over-face gestures when the difficulty level of the given exercise increases. The hand-over-face gestures occur more frequently during problem-solving (easy 23.79%, medium 19.84% and difficult 30.46%) exercises in comparison to reading (easy 16.20%, medium 20.06% and difficult 20.18%)

Effectiveness of interventions to improve the health and housing status of homeless people: a rapid systematic review

Background: Research on interventions to positively impact health and housing status of people who are homeless has received substantially increased attention over the past 5 years. This rapid review examines recent evidence regarding interventions that have been shown to improve the health of homeless people, with particular focus on the effect of these interventions on housing status. Methods: A total of 1,546 articles were identified by a structured search of five electronic databases, a hand search of grey literature and relevant journals, and contact with experts. Two reviewers independently screened the first 10% of titles and abstracts for relevance. Inter-rater reliability was high and as a result only one reviewer screened the remaining titles and abstracts. Articles were included if they were published between January 2004 and December 2009 and examined the effectiveness of an intervention to improve the health or healthcare utilization of people who were homeless, marginally housed, or at risk of homelessness. Two reviewers independently scored all relevant articles for quality. Results: Eighty-four relevant studies were identified; none were of strong quality while ten were rated of moderate quality. For homeless people with mental illness, provision of housing upon hospital discharge was effective in improving sustained housing. For homeless people with substance abuse issues or concurrent disorders, provision of housing was associated with decreased substance use, relapses from periods of substance abstinence, and health services utilization, and increased housing tenure. Abstinent dependent housing was more effective in supporting housing status, substance abstinence, and improved psychiatric outcomes than non-abstinence dependent housing or no housing. Provision of housing also improved health outcomes among homeless populations with HIV. Health promotion programs can decrease risk behaviours among homeless populations. Conclusions: These studies provide important new evidence regarding interventions to improve health, housing status, and access to healthcare for homeless populations. The additional studies included in this current review provide further support for earlier evidence which found that coordinated treatment programs for homeless persons with concurrent mental illness and substance misuse issues usually result in better health and access to healthcare than usual care. This review also provides a synthesis of existing evidence regarding interventions that specifically support homeless populations with HIV.Partial funding for this paper was provided to the Effective Public Health Practice Project by the Region of Peel, Canada